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Abstract — In this paper we provide schemes that achieve rates 
above the 'secrecy capacity' region on a Gaussian wire-tap 
channel. We take the probability of error as the measure of 
reliability at the intended receiver and also as the measure of 
secrecy at the eavesdropper. We show that any rate < R < 
C = 0.51og(l + P/N) is achievable for this case using the 
usual random coding-decoding scheme. We also show the relation 
between probability of error and equivocation as considered in 
physical layer secrecy problems. We then extend the results to 
the fading channels. 

Index Terms — Probability of error, Physical Layer Secrecy, 
Equivocation, Strong converse. 

I. Introduction 

Information theoretic security is being widely studied in 
recent times ([ 14|, [3 1). It provides fundamental limits of secret 
communication. Unlike in cryptography, the information theo- 
retic techniques, are not based on complexity of computational 
hardness of certain problems. Information theoretic security 
can also be used in a system in addition to cryptographic tech- 
niques to add additional layers of protection to the information 
transmission or to achieve key agreement and/or distribution. 

Information theoretic formulations for 'reliable communica- 
tion' and 'secrecy' were provided in classic papers of Shannon 
lfl9l and l20l . A secret communication system model considers 
reliable transmission of information from the transmitter to the 
intended receiver and this information should not be decoded 
by the eavesdropper. Shannon characterized reliable commu- 
nication using average probability of error and 'secrecy' using 
equivocation. The properties of equivocation are also discussed 
in |20|. Shannon considered the case of perfect secrecy when 
equivocation H(W\Z n ) — H(W), where W is the message 
transmitted, and Z n is the received symbol at the eavesdropper. 
This of course implies I(W; Z n ) = 0. A weaker form of 
equivocation as compared to Shannon is I(W, Z n ) —> as 
n — >• oo 0. These are further weakened to I(W; Z n )/n — > 
in lfl6l . This implies that the average probability of error in 
the eavesdropper goes to 1. 

In this set-up of 'secret communication' a natural definition 
of secrecy would be that the intended receiver decodes the 
message with average probability of error going to zero and 
the eavesdropper decodes the message with average probability 
of error going to one. Recently similar notion of secrecy is also 
considered in [2| to obtain lattice codes for secret communi- 
cation. We consider this definition in the present paper and 



study the achievable rates on the Gaussian wiretap channel 
and show that this natural definition leads to improved rates. 
We also relate the probability of error at the eavesdropper to 
equivocation to relate this secrecy to the equivocation based 
secrecy. In the following we survey the related literature. 

'Wiretap channel' introduced and studied by Wyner ||231 . 
captures the physical communication secrecy problem. 'Wire- 
tap channel' is modelled as a degraded broadcast channel 
and assumes that the channel between the transmitter and 
the receiver is better than the channel from the transmitter to 
the eavesdropper. Wyner's work was extended by Leung and 
Hellman 1 15 1 to the Gaussian channel. Csiszar and Korner [6| 
considers a general discrete memoryless broadcast channel, 
and shows that the secrecy capacity is positive if the main 
channel to the intended user is more capable than of the 
eavesdropper, and zero if the wiretapper's channel is less noisy. 
The secrecy over a fading channel was studied in [12|. In [4|, 
a wire-tap channel with slow fading is studied where an outage 
analysis with full CSI of the eavesdropper and imperfect CSI 
of the eavesdropper was performed. It is shown that in wireless 
channels fading helps to provide secrecy rates even of the 
average SNR of the main channel is poor compared to the 
eavesdropper's channel. 

Our notion of secrecy will be related to the equivocation 
based secrecy via converse results in Information Theory. 
Random coding arguments are used to prove capacity achiev- 
abiliy for a particular scheme and Fano's inequality is usually 
employed to show converse [5| that no scheme can give 
rates better than the capacity. The usual converse results 
consider average probability of error and are called 'weak 
converse'. Using 'weak converse' it is shown that for a discrete 
memoryless channel when R> C the probability of decoding 
error is bounded away from zero [9|. The proof uses Fano's 
inequality. The strong converse shows that the maximum 
probability of decoding error of a MAP (Maximum A posterior 
Probability) decoder tends to one as block length goes to 
infinity ll22l . A stronger form of converse was proved by 
Arimoto 1 1 1 where it is shown that at rates higher than capacity 
the average probability of error goes to one exponentially 
fast with the block length. This result was generalized to 
continuous alphabets and general measures in lfl8l . 

Fano's inequality provides a tight lower bound on the 
error probability in terms of the conditional entropy. A tight 
upper bound on the error probability in terms of conditional 
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Fig. 1. Wiretap channel 

entropy is provided in fU which also finds relations between 
probability of error in a MAP decoder and the conditional 
entropy. Relation between error probability and conditional 
entropy are also provided in lfj"3l . 

The rest of the paper is organized as follows: In Section 
II, we define the model and notation. In Section III, we 
provide coding-decoding schemes for perfect secrecy and 
using average probability of error as the measure of both 
reliability and secrecy. We show that rates above equivocation 
based perfect secrecy capacity are achievable for a Gaussian 
channel. Section IV finds the relation between the chosen 
criterion of probability of error and equivocation. Section V 
extends the results to a Gaussian fading channel. We conclude 
the paper in section VI. 

II. Model and Notation 

We consider a Gaussian Wiretap system where a transmitter 
Alice wants to communicate the message to a legitimate 
receiver Bob. There is also an eavesdropper, Eve, who is 
trying to get access to the message sent to Bob. The model 
is denoted in Figure Q] The transmitter chooses message 
W for transmission from a set W = {1,2, ...,M = 2 nR } 
with uniform distribution. These messages are encoded into 
codewords (Xi, ...,X n ) with a power constraint £?[AT 2 ] < P. 
At time i, Alice transmits Xi, Then Bob receives Yj = 
Xi + Nu and the eavesdropper receives Zi = Xi + N^i. 
The noise sequences {Nu} and {N 2 i} are assumed to be 
independent of {Xi} and also of each other. Also, we assume 
that Nu ~ A/"(0, a\) and N 2l ~ Af(0, a\) and a\ < ctJ . The 
decoder at Bob estimates the transmitted message as W from 
Y n = (Yi, ..., Y n ). It is assumed that Bob as well as Eve know 
the chosen codebooks. We use P™(B) and P^(E) to denote 
the average probability of decoding error for block length n at 
Bob and Eve respectively for the MAP decoder. Our secrecy 
requirement is that P™(B) — y and P™{E) — y 1 as n — y oo. 

III. Capacity Results 

In this section we characterize the achievable rates for the 
model in Figure Q] Let C\ = 0.51og(l + P/of) and C* 2 = 
0.51og(l + P/of). Since a\ < of, d > C 2 . 

Theorem 1: All rates R such that < R < C\ are 
achievable for a Gaussian wiretap channel such that the 
probability of decoding error P™{B), at Bob goes to zero and 
the probability of decoding error P™(E), at Eve goes to one 
as, n — y oo. 

Proof: Consider the region C 2 < R < G\. In this region, 
as in the case of a usual Gaussian channel, we generate n 



length iid Gaussian codewords with X ~ A/"(0, P). It can 
be proved using the channel coding theorem for the Gaussian 
channel [5| that any rate R < C can be achieved for the 
Gaussian channel from Alice to Bob. The condition R < C\ 
ensures reliable communication from Alice to Bob ensuring 
that P"(B) — y exponentially as n — > oo. Also since 
R > C2, by the strong converse to the coding theorem |fl], 
lfl8l the average probability of decoding error for any decoder 
goes to one exponentially as n — y oo. As this happens for 
any codebook, it is valid for the chosen codebook that gives 
reliable communication from Alice to Bob. 

Now consider the region < R < C\. In this re- 
gion we use coding-decoding schemes as above but with 
reduced power aP, < a < 1 such that 0.5 log (1 + 
aP/al) < R < 0.51og(l + aP/af). This ensures that 
we achieve reliable transmission to Bob and secrecy at Eve. 
■ 

From Theorem 1 any rate < R < C is achievable with 
Bob getting the message reliably and eve's probability of error 
as large as we wish. The block length n should be chosen large 
enough to satisfy any target probability of error to Bob and 
Eve. This improves the rate over the secrecy capacity definition 
based on equivocation (|14|): 



C = 0.51og(l + P/af) ~ 0.5 log(l + P/al). 



(1) 



The equivocation based secrecy systems employ a stochastic 
encoder whereas in our scheme all rates < R < C\ can be 
achieved by the usual encoders employing random codebooks 
(in practice one can use LDPC and Turbo codes to obtain rates 
close to C{). For equivocation based schemes also one can get 
the required probability of error to Bob and Eve by ensuring 
large enough block length n. However the rate obtained can 
be quite low and it requires more complex encoders. 

For a\ = 0.1, <t\ = 1.5, and P = 2MB, P?(B) and 
P?(E) are plotted in Fig 2 for n = 50; 100 and 200. In this 
example the range of a over which we can achieve secrecy 
rate is 0.1474 < a < 1. 

A nice geometrical interpretation of channel coding over 
an AWGN channel as a sphere packing problem along with 
upper and lower bounds was provided by Shannon in [21]. 
By similar geometric argument, for the channel from Alice 
to Bob the received vectors at Bob have energy no greater 
than n(P + a\) + 5 and they lie in an n-dimensional sphere 
of radius \Jn(P + af) + S for n large enough with a high 
probability, where 8 is a small positive constant. In the 
following for simplicity we ignore S and consider large n. 
Each decoding sphere (sphere such that if the received vector 
lies in it, it will be decoded as a particular codeword) for 
a small probability of error has a radius of W 



7f and the 
maximum number of non-intersecting spheres in this volume 

\ + ^Y . Hence for R < C x = 0.51og(l + P/<j\), 
each decoding sphere uniquely represents a codeword with a 
large probability and P"(B) — y as n — > oo . However we 
have R > C2 for Eve and the received codewords lie in a 
sphere of radius y/n(P + <t|) and the decoding spheres for a 
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where <j>* is a piecewise linear, continuous, non-decreasing, 
convex function provided in [8| and ir(W\Z n ) is the average 
probability of error for the MAP decoder at Eve. Tr(W\Z n ) in 
(0 can be replaced by the Arimoto's lower bound (IT]) 



ir(W\Z n ) > 1 - e -n{E {p,p)-pR) ^ > /? > -1. 



(6) 



Fig. 2. Probability of error vs a 



Minimizing the exponent with respect to p and maximizing 
w.r.t p provides a universal lower bound. 

V. Fading channel 

A fading wiretap channel model can be mathematically 
represented as: 

Y^hiXi + Nu, (7) 



low probability of error should have radius \Jna\. Thus, the 
decoding spheres overlap at the eavesdropper. As n — > 00, the 
number of overlapping decoding spheres also approach infinity 
and hence P™(E) — > 1. This overlapping creates confusion at 
Eve and can be viewed as an equivalent of superposition codes 
used to confuse Eve in equivocation based secrecy systems 

(ED, 0). 

IV. Relation between probability of error and 
Equivocation 

In this section we compare the secrecy criterion based on 
just probability of error with the usual criterion based on 
equivocation. 

When C 2 < R < Ci, P"(B) ->■ 0, exponentially and 
P™(E) —> 1 exponentially. Thus, Fano's inequality J5) 



Zi = c H X t + Ni 



2l: 



(8) 



H(W\Y n ) < H{Pl\B)) + P?(B)nR 



(2) 



gives H(W\Y n ) — > almost exponentially where H(p) = 
— p\og(p) — (1 — p)log(l —p). Similarly, the upper bound (ff) 
for H (\Z n ) goes to nR exponentially. 

From [8 1 we get more refined results. For Bob, for any 
<p< 1, 

H(W\Y n ) < (1 + l) e -™lE (p,p)- P R] (3) 

P 
where p is the distribution of X and Eo(p,p) is the Gallager's 
random coding bound (|10|) 



E (p,p) = -log 




p(x)p(y\x) 1 +p dx \ dy (4) 



i+p 



and p(y\x) is the channel transition function. Thus, 
H{W\Y n ) -> exponentially. For Eve, since I(W;Z n ) < 
nC 2 , \B{W \Z n )>R~C 2 for all codebooks. 

A more accurate lower bound on H(W | Z n ) can be 
obtained from Theorem 1, [8], 



H{W\Z n ) > cf>*{iT{W\Z n )), 



where hi, gi are the normalized complex channel gains from 
Alice to Bob and Eve respectively at instant i. We assume 
that these gains are available at Alice, Bob and Eve. We take 
erf = cr| = 1. Also denote the instantaneous power gains by 
q(i) — \h(i)\ 2 and r(i) — \g(i)\ 2 . The rest of the model is 
same as in Section II. For this case the capacity achieving 
signalling scheme based on equivocation at Eve is to transmit 
at instances when q > r and adapt the instantaneous power 
according to q and r. The capacity is fl2l : 



C, = 



OO /"OO 



[\og(l + qP*(q,r))- 
log(l +rP*(q,r))]f(q)f(r)dqdr (9) 



where E[P*(q,r)] = P, 
P*(q,r) 



0.5[V(l/r - 1/qf + 4/A(l/r - 1/q) + 

(l/r + l/g)] + (10) 



and A is chosen to satisfy the power constraint with equality. 

Now we extend Theorem 1 to include fading. We use a 
scheme similar to that in |[T2l but with the condition P"(S) — >• 
and P"(E) -» 1 as n -> 00. 

Theorem2: All rates R such that < R < C\ are achiev- 
able for a Gaussian wiretap channel such that the probability of 
decoding error, P™(B), at Bob goes to zero and the probability 
of decoding error, P™(E), at eve goes to one as, n — > 00 where 



C x 



sup 

P(q,r) 



[\og(l + qP(q,r))}f(q)f(r)dqdr. (11) 



The optimal power allocation is 'water-filling' w.r.t. the 
distribution of q conditioned on q > r. 

Proof: Whenever q > r, we transmit data with power 
P(q,r) and rate 0.51og(l + qp(q,r)). We select p(q,r) such 
that 0.bE qtr \[og(l + qP(q,r))] is maximized. This is achieved 



(5) by the above water filling policy. 



VI. Conclusions 

This paper uses a new notion of secrecy for improving the 
rates in a Gaussian wire-tap channel. This new notion is based 
on using probability of error as the measure of secrecy at both 
the intended receiver and also the eavesdropper. In such a set 
up, it is shown that the random codes used for point to point 
communication can be used to provide secrecy as well. Also 
it is shown that this notion of secrecy is weaker compared to 
the equivocation based secrecy. The results are also extended 
to a fading channel. 

We believe that this notion of secrecy is strong enough for 
practical purposes, but uses usual channel code and provides 
the maximum possible rates for reliable transmission to the 
intended receiver. 

Although we have shown these concepts on a Wiretap 
channel, these ideas can obviously be used on other channels 
as well. 



[21] C. E. Shannon, "Probability of error for optimal codes in a Gaussian 
channel," Bell system Technical Journal, Vol. 38, No. 3, May 1959. 

[22] J. Wolfowitz, "Codinq Theorems of Information Theory," Prentice-Hall 
N J, 2 ed Engelwood Cliffs, 1964. 

[23] A. Wyner, "The wire-tap channel," Bell Syst. Tech. J., vol. 54, pp. 1355- 
1387, 1974. 



References 

[I] S. Arimoto, "On the Converse to the Coding Theorem for Discrete 
Memoryless Channels," IEEE Trans. Inform. Theory., vol. 19, no. 3, pp. 
357 359, May 1973. 

[2] J. C. Belfiore and F. Oggier, "Secrecy Gain: a Wiretap Lattice Code 
Design," ISITA 2010, Available : http://arxiv.org/abs/1004.4075 

[3] M. Bloch and J. Barros, "Physical layer security," Cambridge Univ. Press, 
2011. 

[4] M. Bloch, J. Barros, M.R.D. Rodrigues, S.W. McLaughlin, "Wireless 
information-theoretic security," IEEE Transactions on Information The- 
ory, vol. 54, no. 6, pp. 2515-2534, June 2008. 

[5] T. Cover and J. A. Thomas, "Elements of information theory," John Wiley 
and Sons, 2ed., 2006. 

[6] I. Csiszar and J.Korner, "Broadcast channels with confidential messages," 
IEEE Transactions on Information Theory, vol. 82, no. 23, pp. 339-348, 
May 1978. 

[7] R. M. Fano, "Transmission of Information," MIT press, 1961. 

[8] M. Feder and N. Merhav, "Relations Between Entropy and Error Proba- 
bility," IEEE Trans. Inform. Theory., VOL. 40, NO. 1, Jan. 1994. 

[9] A. Feinstein, " Foundations of information theory," McGraw-Hill, N.Y., 
1954. 

[10] R. G. Gallagar, "Information Theory and Reliable Communication," 
John Wiley and Sons, 1968. 

[II] A. J. Goldsmith and P. P. Varia, "Capacity of Fading Channels with 
Channel Side Information," IEEE Trans. Inform. Theory., Vol. 43, No. 6, 
Nov. 1997. 

[12] P. K. Gopala, L. Lai, H. El Gamal, "On the secrecy capacity of fading 

channels," IEEE Trans. Info. Theory, vol. 54, no. 10, pp. 4687^1698, 

October 2008. 
[13] S. W. Ho and S. Verdu, "On the Interplay Between Conditional Entropy 

and Error Probability," IEEE Trans. Inform. Theory., Vol. 56, No. 12, 

Dec. 2010. 
[14] Y. Liang, H. V. Poor, S. Shamai, "Information theoretic security," 

Foundations and Trends in Communications and Information Theory, vol. 

5, no. 4-5 (2008), pp. 355-580, 2009. 
[15] S. K. Leung- Yan-Cheong and M. E. Hellman, "Gaussian wire-tap 

channel," IEEE Transactions on Information Theory, vol. 82, no. 24 (4), 

pp. 451^156, July 1978. 
[16] U. M. Maurer and S. Wolf, "Information-theoretic key agreement: From 

weak to strong secrecy for free," Proceedings of the EUROCRYPT 2000 

on Advances in Cryptology,, vol. 1807, pp. 352368, Lecture Notes in 

Computer Science, Berlin, Germany: Springer, 2000. 
[17] A. J. Menezes, P. C. V. Oorschot, and S. A. Vanstone, "Handbook of 

applied cryptography," Boca Raton, FL, USA: CRC Press, 1996. 
[18] Y. Polyanskiy and S. Verdu, "Arimoto Channel Coding Converse and 

Renyi Divergence," 48 Annual Allerton Conference, Monticello, IL, 2010. 
[19] C. E. Shannon, "A mathematical theory of communication," Bell System 

Technical Journal, vol. 27, pp. 379423, 623-656, July, October, 1948. 
[20] C. E. Shannon, "Communication of secrecy systems," Bell Syst. Tech. 

J., vol. 28, pp. 656-715, October 1949. 



